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Objectives 


The general aim of this unit is to familiarize you with some of the theoret- 
ical and practical aspects of the solution of systems of linear equations. 


After working through this unit you should be able to: 


(1) 
(ii) 
(iii) 
(iv) 


(v) 
(v1) 


Note 


solve a system of linear equations by the Gauss elimination method ; 
discuss the existence and uniqueness problems for systems of linear 
equations, and give geometrical illustrations in simple cases ; 

define elementary row operations on a matrix, and construct 
elementary matrices corresponding to given elementary operations; 
find the inverse of a given non-singular square matrix; 

calculate the rank of a given matrix; 

explain the connection between the rank ofa matrix and the existence 
and uniqueness problems for systems of linear equations. 


Before working through this correspondence text, make sure you have 
read the general introduction to the mathematics course in the Study 
Guide, as this explains the philosophy underlying the whole course. 
You should also be familiar with the section which explains how a text is 
constructed and the meanings attached to the stars and other symbols in 
the margin, as this will help you to find your way through the text. 
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26.1.0 


The Nature of the 
Solution 
26.1.1 
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1 Unit 6 i Method 
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! Unit 22 ! in Matrix Form 
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Linear Algebra IV 
Unit 28 


Computer Program to 
perform Elementary Row 
Operations 

26.5 


9 


Glossary 


Terms which are defined in this glossary are printed in CAPITALS. 


AUGMENTED MATRIX 


BACK-SUBSTITUTION 


COLUMN VECTOR 


ELEMENTARY MATRIX 


ELEMENTARY 
OPERATIONS 


ELEMENTARY ROW 
OPERATIONS 


EQUIVALENT 
SYSTEMS 


EXISTENCE 
PROBLEM 


GAUSS ELIMINATION 


METHOD 


INVERSE MATRIX 


vil 


The AUGMENTED MATRIX for the SYSTEM OF EQUA- 
TIONS 


Ax =B 
is the MATRIX 
(A b) = (A: D), 


having as its columns the columns of A, together 
with the COLUMN VECTOR Db. 


When the SYSTEM OF EQUATIONS 


Ax =8 


is such that all the elements of A below the LEADING 
DIAGONAL are zero, the system can be solved by 
BACK-SUBSTITUTION. If there are m unknowns, 
X1,-++,X,, this involves finding the value of the 
variable x, from the last equation, substituting this 
value into the previous equation to find the value of 
X,—-,> and so on. 


A COLUMN VECTOR is an -tuple of numbers written 
in a column; it can be regarded as a MATRIX of 
ORDER 7 X |. 


An ELEMENTARY MATRIX iS a MATRIX obtained from 
the identity matrix by one ELEMENTARY ROW 
OPERATION. 


The following operations on a SYSTEM OF LINEAR 
EQUATIONS are ELEMENTARY OPERATIONS: 
(i) interchange any two equations; 
(ii) multiply any equation by a non-zero number; 
(iii) adda multiple of one equation to another 
equation. 


The following operations on a MATRIX are ELEMENT- 
ARY ROW OPERATIONS: 
(i) interchange any two rows; 
(ii) multiply any row by a non-zero number ; 
(iii) adda multiple of one row to another row. 


Two SYSTEMS OF EQUATIONS are EQUIVALENT if they 
have the same SOLUTION SET. 


The EXISTENCE PROBLEM is the problem: Does a 
solution exist? i.e. Is the SOLUTION SET non-empty? 


The GAUSS ELIMINATION METHOD is a systematic 
method of solving a SYSTEM OF LINEAR EQUATIONS. 
See section 26.1.2. 


The INVERSE MATRIX of the NON-SINGULAR 7 X Nn 
matrix A is the (unique) n x n matrix A~‘ such 
that 


AA“! = AA=],,. 
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Page 


23 


10 


14 


31 


29 


17 


27 


KERNEL 


LEADING DIAGONAL 


LINEAR EQUATION 


LINEAR 
TRANSFORMATION 


MATRIX (™ X n) 


NON-SINGULAR 
MATRIX 


ORDER OF A 
MATRIX 


RANK OF A MATRIX 
ROW VECTOR 

SINGULAR MATRIX 
SOLUTION SET OF A 


SYSTEM OF 
EQUATIONS 


SQUARE MATRIX 


The KERNEL of a morphism is the set of elements in 15 
the domain which map to the zero element in the 
codomain. 


The LEADING DIAGONAL of a SQUARE MATRIX is the 33 
diagonal from the top left-hand corner to the bottom 
right-hand corner. 


A LINEAR EQUATION is an equation of the form 2 


1X + MyX. +--+ A,X, 7 ss 


where O15 Oa ++ 5 Oy ER. Pe 


A LINEAR TRANSFORMATION is a morphism from one 1 
vector space to another. 


A MATRIX (m xX n) isa rectangular array of numbers, 12 
having m rows and n columns. 


The MATRIX OF COEFFICIENTS of the SYSTEM OF 13 
EQUATIONS: 
Ay 4X, + Ay2X_o +--+: + G;,X, = D, 


41X41 + A472X2 a a5 X, — b, 


GyaXt{ TAgeXs + eee 


iS 


QGnmi Gm2 °*°* 4Gnn 


A SQUARE MATRIX Of ORDER 71 X 1 1S NON-SINGULAR 27 
if it has RANK n. 


The ORDER OF A MATRIX is m xX n if it has m rows Zt 
and n columns. If m = n, it is said to be of order n. 


The RANK OF A MATRIX is the maximum number of — 21 
linearly independent column (or row) vectors of the 
matrix. 


A ROW VECTOR is an m-tuple of numbers written in— 14 
a row; it can be regarded as a MATRIX Of ORDER 
1 x m. 


A SINGULAR MATRIX iS a SQUARE MATRIX Of ORDER 27 
n X n which has RANK less than n. 


The SOLUTION SET OF A SYSTEM OF ™ EQUATIONS in 71 3 
variables is the subset S of R” defined by 
S = 5S, £1 S.41 --- 8... 
where S; is the solution set of the ith equation (i.e. a 
set of n-tuples), i = 1,2,---,m. 


A SQUARE MATRIX iS a MATRIX which has the same 27 
number of rows as it has columns. 


Vii 


SYSTEM OF A SYSTEM OF SIMULTANEOUS LINEAR EQUATIONS is a 
SIMULTANEOUS set of LINEAR EQUATIONS in the same variables. (See 
LINEAR EQUATIONS also SOLUTION SET.) 


UNIQUENESS PROBLEM The UNIQUENESS PROBLEM is the problem: Is the 
solution unique? i.e. Does the SOLUTION SET have 
only a single member? 


Vili 


17 


Notation 


a) 
A 


The empty set. 


The matrix A, and also the linear transformation 
defined by A. For example, 


G11 °** Aty 
A21°°*Azy 
A= 
QAm1*** Onn 
xX} Qy1X; e+ + Q4,X, 
X2 Qz1X1 +++ + AzpX, 
A : -—> : 
Xn AmiX, bree + AmnXn 
The basis for R", where 
0 
0 0 
€,; =| O},e, =] 0 ],...,¢, =| Of}. 
0 0 l 


The ith column of the matrix A. 
The rank of the matrix A. 
The augmented matrix for the system 


Ax =D. 


The inverse of A, where A is a non-singular matrix: 
also the inverse mapping, where A is an isomorphism. 


The identity matrix of order n x n. 


The elementary row operation: interchange rows R, 
and R,. 


The elementary row operation: multiply row R, 
by the number k. 


The elementary row operation: add a multiple, k, of 
row R, torow R,. 


An elementary matrix. 


19 


19 
21 
23 


27 


27 
29 


30 


30 


31 
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26.0 INTRODUCTION 


In this unit we consider some theoretical aspects of solving systems of 
simultaneous linear equations. We use both the vector notation intro- 
duced in Unit 22, Linear Algebra I and the matrix notation introduced in 
Unit 23, Linear Algebra II in an investigation of the existence and unique- 
ness of solutions to such systems of equations. The aim of the unit is two- 
fold. Firstly, it aims to familiarize you with a matrix, both as a computa- 
tional tool and as a representation of a morphism from one vector space 
to another. Secondly, it prepares the ground for Unit 28, Linear Algebra 
IV, in which practical methods of solving systems of simultaneous equa- 
tions will be discussed. 


An important theme of this unit is the notion of a morphism (also known, 
in the context of vector spaces, as a linear transformation) between two 
vector spaces. In particular, we shall discuss under what circumstances an 
inverse morphism exists. Towards the end of this text we discuss a method 
for finding the inverse morphism (when it exists). This method itself is not 
very practical, but nevertheless it is important in principle and it is the 
basis of a number of practical methods. 


26.1 SYSTEMS OF LINEAR EQUATIONS 


26.1.0 Introduction 


We have already considered the idea of simultaneous equations and how 
they relate to mappings between vector spaces (Unit 23, Linear Al gebra II). 
Before we discuss this in greater detail, we shall explain what is meant bya 
system of simultaneous linear equations and a solution set of such a system. 
This will lead us to consider how to find a solution and whether the solu- 
tion is unique—and indeed whether a solution exists at all. 


We can consider the equation 
2X; — X> — oe 


as defining the set of all ordered pairs of real numbers (x,, x,) such that 
2X; — X> = 2; that is, 


S, = ((%1, X2):2x, — x, = 45 


which can be represented diagrammatically as in the following figure: 
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26.0 


Introduction 
x * 


26.1 


26.1.0 


Introduction 
* * 


Similarly, if we consider the equation x, + x, = 3, it defines the set S,, 
where 


S, = AS a; + is = 3} 


S, is represented in the figure below: 


We now have two equations: 
pa a = a) — Z 
Xi + X97 — <3 


If we consider these two equations together, they form a system of simul- 
taneous equations in the sense that we consider just those pairs (x,, x2) 
which satisfy both equations. Each of the equations has two variables, x, 
and x,, and each equation defines a straight line in the plane. We therefore 
say that the equations are linear. Thus the system of equations is a set of 
two simultaneous linear equations in two variables, x, and x>. 


In this text we shall deal with systems of linear equations, but we shall 
generalize to consider/W simultaneous equations in # “variables (also 
called unknowns). A linear equation in n variables, x,,x,,...,X,, 1S an 
equation of the form 


AyX; + AzrX2 + oe + anXn = b, 


where a,,a,,...,a,, b are known numbers. As we have seen, for two 
variables we can represent such an equation by a line; for three variables 
the representation is a plane; for more than three variables we have no 
visual representation, but geometers say that such an equation represents a 
hyper-plane. : 


We now consider the solution set of a system of simultaneous linear 
equations. 


The solution set, S,, of 

2X, —X,=2 
is the subset of R x R which maps to 2 under the mapping 

F 2(X1,.X2)"—> 2x, — x, ix, x,jek =x K 
Similarly, S, is the subset which maps to 3 under the mapping 


£1%;, %g)" X, +X ((x,,X2)€R x R). 
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The solution set of the system of the two simultaneous equations is the set 
S of elements of R x R which map to 2 under f and 3 under g; that is, 


B= 5, 1453, 


In other words, the solution set of the system is the set of ordered pairs 
{(x1, X2)} such that each element of this set belongs both to the set S, and 
to the set S,. 


We can see from the above diagram that S consists of one element only, 
namely the point of intersection of the two straight lines. If the co-ordinates 
of this point are « and B, then 


S = {(«, B)}. 


For a system of m simultaneous linear equations in n variables, x,,x,,..., 
X,, the solution set S is the subset of R” defined by Definition 2 


Sad, FS) Ae 


where S; is the solution set of the ith equation (a set ofn-tuples), i = 1,2,..., 
m. 
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26.1.1 The Nature of the Solution 26.1.1 
Consider the solution set of the system of equations: Discussion 
—2x, + 3x, = 6 = 
2x; — 3X, = 12 


The graphs of the equations are two parallel lines and hence have no 
common point, so that if 


S, = {(x;, xz)2—2x, + 3x; = Gj, 
and 7 

S, = tix,, x):25, — 35, = 
then 

§ «SS oS 


The solution set is empty, and we say that the system of equations has no 
solution. : 


There are examples of systems of linear equations for which the corres- 
ponding graphs are non-parallel straight lines and yet the solution sets are 
empty. | 


If we consider the equations 
2X, —X,=2 
Xx, +x, =3 
—x, + 5x, =5, 
they define the sets 
Sy ={(%,, %2).2%; — & = 7} 
S, = {{(%)%3)-5, + 3% = 3 
S, = {(%;, X,)) =x; + 5x, = 5, 
and the solution set S of the system is 
S=58,NS, 1S; 
= (8, 9}. 


This system has only one solution. 
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3 S, 
S 
aN 3 


23s $10S208s 
a Xy 
4 


On the other hand, the solution set of the system 
es — 2x, =2 
= See 
Ax, + 5x, = 20, 
which defines the three sets 
S; = {(%1, X2):x, — 2x, = 2} 
S. = {(%1, X2):x,; — x, = —2} 
S3 = {(X1, X2):4x, + 5x2 = 20}, 
is empty; that is, 3 
sS=5S, 1S, fS; = @. 


$,0S2nS3"O 


The figure shows that although any two of the lines intersect, so that 
S, 1S, # O,8,;NS,; 4 BandS,NS,# @, 

nevertheless, the three lines do not all intersect at acommon point, so that 
5, (1S, fi S-= @&. 


It follows that the system of equations has no solution. 


An equation of the type 
ax, + bx, + CX 3 a d 


(where a, b,c and d are constants) can be represented by a plane in a three- 
dimensional geometric space. The two equations 


2X, -—- X,+ x3, =4 
%, + 3x5 — 2%, = 9 

define two sets, S, and S,, of ordered triples: 

S, = {(%1,X2,%3):2x; — x, + x3 = 4} 

S, = {(%1,%>,%3):%1 + 3x = 2h =F. 
The solution set of an equation involving three variables, for example, 

2x; —X, +x3;=4 
is the set of elements of R° (i.e. R x R x R) which map to 4 under the 
mapping 

PRs, 3a) = a + (Se wee i a eS 
Again, the solution set S of the above system is 

S=3, tis. 


which is the set of elements (triples of numbers) which are common to both 
S, and S,. In our example, the two planes meet in a straight line, which 
therefore defines S. 


In this case, the system of equations has more than one solution. 
On the other hand, the two planes defined by the equations 
2X, —- X,- x3,=4 
4x, — 2x, — 2x3; =7 


are parallel. The planes do not intersect and the set S is empty, so this 
system has no solution. 


In general, for any system of linear equations, we distinguish three types of 
solution set: 


(i) a solution set which is empty, in which case we say that the system 
has no solution; 

(ii) a solution set which contains just one element (an n-tuple, for a 
system of equations in n variables), in which case we say that the 
system has a unique solution; 

(iii) a solution set which contains more than one element, in which case 
we say that the system has more than one solution. 
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Exercise 1 


Examine each of the following systems of linear equations. Distinguish the 
three types: 


A:no solution; 
B: unique solution; 
C:more than one solution. 


Indicate, by a tick in the appropriate box, the class to which each system 
belongs. (There is no need to solve the equations: a geometrical argument 
is sufficient, but in case you find it easier to use an algebraic argument, we 
give some details in the solution.) 


4 

3 

a = ae 
=§ 

2 


(iv) —X,; +X, =2 


Note 

Notice that we ought really to specify how many variables are involved. 
Thus in (iv), three variables are involved, although each individual equa- 
tion involves only two. We could make this clear by writing 


$2, Xs $x = Ss 


and so on. (Where these equations arise in practice the number of variables 
is usually clear from the context.) There is a considerable difference bet- 
ween the system in (i) which is taken to involve two variables, and the 
system 


iy he + ee 
2X4 +X + 0x5-= 3, 


SO we specify that in the first three parts of this exercise, two variables are 
involved. a 
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Solution 1 Solution 1 


(i) The solution set is {(¢, —3)!, and consists of a unique element. 

(ii) If this system of equations has a solution, it means that the 3 lines 
represented by these equations intersect at a point. We can find the 
co-ordinates of the point of intersection of the first two lines and then 
check whether the third line also passes through it. The first two lines 
intersect at the point (2, 4). Substituting these values for x, and x, in 


the third equation gives 
Be oe 


Hence the third line does not pass through this point. The solution 
set of the system is empty. 

(iii) On multiplying the second equation by (—1), we see that the two 
equations have the same solution set. The solution set has many 
elements; it is: 


{(x1,%2):3x, — 4x, = —I}. 
(iv) Adding the first equation to the third, we get 
7 X4 a X3 a 3 


and the second equation is 


a) + X3 — 0. 
These equations cannot be satisfied simultaneously ; there is no solu- 
tion. | = 
26.1.2 Solving Systems of Linear Equations 26.1.2 
It may seem fairly obvious to you that the solution set of a system of Main Text 
simultaneous equations is unaffected by the following elementary opera- Definition 1 
tions: 7 


(i) interchanging any two equations of the system; 
(11) multiplying every term in an equation by some non-zero constant; 
(111) adding a multiple of one equation to another equation. 


We could give some justification for the assertion that these operations 
do not change the solution set of a system, but without an axiomatic basis 
for our discussion such an argument would have no real validity. You 
may, however, like to look again at Unit 6, Inequalities, where we discussed 
the idea of equivalent equations or inequalities and equivalence preserving 
operations. 


The Method of Gauss Elimination 


Although the three elementary operations do not change the solution set, 
they do change the equations of the system considered. We obtain a 
different system of equations which has the same solution set as the 
original system. Any two linear systems having the same solution set 
are said to be equivalent systems. 


Many methods of solving systems of simultaneous linear equations depend 
on finding an equivalent system for which it is simple to find the solution 
set. We shall illustrate this by solving the system of equations: 


2x, + . ig = 3 
6x, — xX, —9x,=7 
4x, + 3x5, +x, =5 


We shall use a method known as the Gauss elimination method to solve 
this system ; the method is a formalization of a procedure with which you 
are probably familiar. We begin by adding appropriate multiples of the 
first equation to each of the other two so as to eliminate x, from the latter 
two equations. We then add an appropriate multiple of the (new) second 
equation to the (new) third equation so as to eliminate x, from the latter. 
We then have a system of equations, equivalent to the original system, 
which can be solved easily. 


If we denote the three equations in each of the equivalent systems by R,, 
R, and R; in that order, then we can outline the above sequence of 
operations in the following diagram. 


—————————————— ee 


Action System 
eS ee ee ee 
System of equations Variables 
R, X15%X2,%3 
R, X1,%2,X3 
R, X15 X2,X3 
Eliminate variable x, in R, and R, 
by adding multiples of R, to R, and 
R, to form new R, and R;j. 
Equivalent system 
of equations Variables 
R, X1; X2,X3 
R, X2,X3 
R, X72, X3 
Eliminate variable x, in R,; by 
adding a multiple of R, to R; to 
form a new R,. 
Equivalent system 
of equations Variables 
R, X15X2,X3 
R, X2,%3 
R; X3 


We apply this method to our given system of equations. In order to 
eliminate the variable x, from R,, we have to multiply R, by —3 and add 
it to R,; symbolically we have 


R,+—> R, + (—3R,)). 
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We then have 
(R,) 2X, + X,—-— X3=3 
(R,) —4x, — 6x, = -2 
(R3) 4x, + 3x, + x3 =5 
To complete the first stage we eliminate x, from R;: 
R3'——>R; + (—2R)), 
to give 
(R,) 2x, + X,-— xX3=3 
(R;) —4x, — 6x, = -2 
(R3) x, + 3x, = —-1 


We now go to stage 2 and eliminate x, from R;: 


R;+—— R, + +R,. 


We obtain 
(R;) 2X, + X2,-— xX3=3 
(R;) —4x, — 6x, = -2 
(R3) 3X3 = —-3 


This system, which is equivalent to the original system, is now in a form 
which can be easily solved by back-substitution. This means that we 
obtain the value of x3 from the last equation, and then substitute this 
value in the second equation to obtain x,, and finally we substitute 
values of x3 and x, in the first equation to obtain x,. 


From &,: x, = —1 
From R,:4x, = 2 — 6x3; => SZ 
From R,:2x, =3— xX, +x3;>x,=0 


The solution set is 


{(0, 2, —1)}-. 


This is the solution set of the given system. You will note that it consists of 
one element only. Later we shall see just why there are no other elements 
in the solution set. 


The following points should be noted: 

(i) The elimination method is systematic. We take no notice of any 
quick tricks based on the particular numbers in the equations. This 
is because we want a method which we can discuss theoretically and 
implement mechanically (on a calculating device). 

(ii) The method is deceptively simple. The deception lies in the fact that 
we have chosen a relatively small system and done our arithmetic 
exactly. In general, and especially when using a calculating machine, 
rounding errors will be involved which can, in unfavourable cases, 
cause serious trouble. Although a discussion of such points would bea 
useful application of what we have already learnt about error arith- 
metic in this course, we shall be more interested in theoretical 
considerations in this unit. 3 

(iii) Slight variations in the method may be necessary. For instance, there 
may be no x, in the first equation. Such variations are dealt with 
easily in hand calculations, but require care in automatic computing. 

(iv) Gauss elimination is an elimination method, as opposed to an iterative 
method. In the former, we proceed step by step towards a solution, 
which is obtained at the end of the process. In the latter, we obtain 


10 
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an estimate of the solution at each stage in the process. We do not 
discuss iterative methods here. 

(v) As a numerical method, the method we have described has one 
deficiency : it has no check built into it. Of course, we can check our 
solution by direct substitution into the original system, but although 
this may tell us that we have made an error, it will not tell us where 
the error occurred. In fact it is quite easy to build a “‘running check’”’ 
into the method, which checks each stage in the calculation. 


We shall look at some of these points in Unit 28, Linear Algebra IV, when 
we consider one of the practical aspects of solving linear equations: for 
the present, we shall deal mainly with the theoretical aspects. 


Exercise 1 Exercise 1 
== : (3 minutes) 
Use the Gauss elimination method to solve the following simultaneous 


equations: 
() 3x; — 2%, = 1 
4x, + x, =3 
(iil) x, —2x,—-— x3 = —6 
X, — 2X9-+ 2x, = 3 


a + X5 + x; =4 & 


Solution 1 
(i) The solution set is {(77, 7)}. 
(ii) Eliminating x, from R, and R3, we obtain 
xX, — 2x, —x, = —6 
Ji4 = 9 
—X, = —2 


It is unnecessary to carry on further, since the solutions can be found by 
back-substitution : 


X> =. 
X3 == 3 ) 
Xi — —6 + X3 + 2X5 — 1 


Hence the solution set is {(1, 2, 3)}. a 


26.2 MATRICES AND SYSTEMS OF LINEAR 
EQUATIONS 


26.2.1 Systems of Linear Equations in Matrix Form 


We met matrices in Unit 23, Linear Algebra II, where they were used as 
convenient shorthand notation in the context of systems of equations. 
Now we are going to take the subject a little further. The development of 
notation is one of the features of mathematics. Notation usually begins as 
an abbreviation adopted for convenience, but may sometimes lead to 
significant advances as new concepts evolve around it. Matrices first 
appeared in about the year 1858, when Cayley introduced the notation: 


Qi, Gy2°*' Ay xX; b, 
Ar, 422°°' Ary, X92 b, 
An} Am2°°: Ann Xn by, 


as a shorthand for the system of m simultaneous linear equations in n 
unknowns, x,,X,...,X 


> 
A1,4X4 + A,2X2 + rot i AinXn = b, 


A.4X4 + A72X2 + ane + AonXn = b, 


AniX1 » Amn2X2 5 eae AnnXn = _ 


You will notice that we use a double suffix notation for the coefficients. 
At first sight this may seem rather awesome, but it proves to be very 
useful. The first suffix specifies the equation to which the coefficient 
belongs, and the second suffix specifies the variable to which the coefficient 
is attached. Thus the element in the ith row and the jth column of the 
matrix of coefficients is a;;, and a;; is the coefficient of the variable x; in the 
ith equation. 


The significant feature of Cayley’s shorthand notation is the disentangle- 
ment of the array of coefficients from the variables. This allows us to 
abbreviate still further by writing the system as 
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Arthur Cayley, 1821-1895 
(Mansell Collection) 
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where A is the matrix of coefficients: 
41, 4j2°** Ay, 


Gzy - 843°" Se, 


An 1 Amn2 Qinn 


and x is the (column) matrix of the n variables: 


by 
by 
bof 
bm 
Do you feel that you have “‘been here before’’? Discussion 


By virtue of what it denotes, this notation embodies the definition of 
premultiplication of a column matrix by another matrix, which we 
denoted by (J in section 23.2.3 of Unit 23. We saw that [J led to the 
definition of a more general operation of matrix multiplication, which we 
denoted by *. We have already discussed the properties of * in Unit 23. 
(You may like to revise them by re-reading section 23.2.5.) In fact, the 
only new thing introduced here is the double suffix notation for the matrix 
elements. There is one other simplification which we have made: in 
accordance with general practice, we have dropped the symbol * between 
A and x. 


Now that we have written our system of linear equations in matrix form, 
the solution set is a set of n-element column matrices, such that y belongs 
to the solution set if and only if 


Ay = b. 


We know that the solution set may be empty, or consist of one element 
only, or consist of more than one element. 


In section 26.1.2 we solved the system of equations: 
2x, +. 1x: — 1x, = 3 
6x, — 1x, — 9x3; =7 
AX ts eg =," 


and found the solution set to be {(0,2, —1)}, the set having the one 
element only. In matrix notation we would write the system of equations 
as 


Ax= 4 
where 
2 1 -1 x, 3 
A= |6 -1 —-9], x= | x2] andb=1{7 
+ 3 1 X3 2 


The solution set consists of one element y, namely 


In section 23.2.1 of Unit 23, Linear Algebra II, we showed that every 
system of m linear equations in n variables defines a morphism from the 
vector space R” to the vector space R”, and conversely, any morphism 
from R”" to R™ can be represented by such a system of linear equations. 
We saw that if we know the image of a basis of R”, then we can find the 
image of any element of R", expressed as a linear combination of base 
vectors of R™. In other words, we can associate the matrix A in the equation 


A being a matrix of order m x n, with a morphism 
Pix As EF, 


which maps R” to R”™. In this text we assume that we have chosen bases 
for R” and R™, and that we use these bases throughout, so that we identify 
the m x n matrix A with the morphism from R" to R”™. (Notice that we 
use x for an element of R” to distinguish it from the particular n-element 
column matrix x; but we could just as well turn the set of all n-element 
column matrices into a vector space and regard T(or A) as mapping this 
space into the space of all m-element column matrices.) 


So by introducing an appropriate notation for systems of linear equations, 
we have a bird’s eye view of such systems. Instead of examining in detail 
each equation of the system, we examine the whole system and treat it as 
just one member of all possible such systems. It does not follow that this 
will necessarily result in any spectacular discoveries, but it may give us 
a better insight and understanding of these systems. 


There are further advantages in using the matrix notation. For example, 
we can consider the matrix A to be made up of matrices of smaller order 
than A itself; such matrices are called sub-matrices of A. All these sub- 
matrices of A fit together to make up the matrix A. As particular examples 
of this, we can think of the n columns of elements of the (m x n) matrix A 
as n column vectors or as n sub-matrices of order m x 1. Similarly, we 
can think of the matrix A as one column of m row vectors, each row vector 
having n components (i.e. the components of the corresponding row of 
the matrix A). 


Example 1 


We can write the matrix 


as 
A = (b, b, b3), 


where b,,b,,b3 are the matrices 


m=} m-(_Jjomen=() 
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Also we can write A as 


where c,, c, are the matrices 
é; =i 2 3)andc, =(2 —2 7). a 


We call c, and c, row matrices to distinguish them from the column 
matrices b,, b, and b3, which are the columns of the matrix A. Both row 
and column matrices can be regarded as n- and m-tuples of numbers, 
and we can regard them as elements of vector spaces isomorphic to R” 
and R”™ respectively. Hence the names row and column vectors. 


26.2.2 The Nature of the Solution 


In the last section we referred back to the work on vector spaces which 
we covered in Unit 23, Linear Algebra II. In this and the following section, 
we shall again make use of some of the results mentioned there. 


Our problem is to solve a system of linear equations, which in matrix 
form can be written 


Ax =p, 


where A is a matrix of order m x n. A defines a morphism from R" to R”, 
also denoted by A: 


A y= AS (x € R”). 


(Notice that we now underline x and b, to emphasize that we are consider- 
ing them as vectors, i.e. elements of a vector space.) 


We know from section 23.1.4 of Unit 23, that we can obtain the required 
solution set in two parts. 


(i) We need just one element of the actual solution set, ie. one vector x 
which satisfies the equation 


Ax = db. 


(1) We need the complete solution set of the equation 
As =3) 


where Q is the zero vector (i.e. the column matrix all of whose elements 
are zero) in R”. This solution set is the kernel of the morphism. 


The actual solution set of the original system is then obtained by adding 
the solution in (i) to each solution in (ii). 


We shall verify this result again in our particular circumstances to remind 
you of the argument. 


Suppose that x, is a solution of Equation (1), and x, is a member of the 
kernel, K (i.e. a solution of Equation (2)); then 


A(x, + X;) = AX, + AX, (A is a morphism) 


b+0 (hypothesis) 
=p (definition of Q) 


This shows that (x, + xX,) is an element of the solution set of Equation 


(1). 
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Also, every element of the solution set of Equation (1) can be written in the 
form x, + X,. For if we let x, be any element of that solution set, then 


It follows that the vector (x, — X,) is a solution of Equation (2), Le. an 
element of K, so that we can write 


where x, € K, and so 


Now x, is unique, by Axiom 1 for a vector space, so it follows that there 
is a one-one correspondence between the solution set and the kernel. 
Thus, the solution set is 

‘¥O3; = Xp = = Xk» xX, E K}. 


—1 — 


x, is called a particular solution of Ax = 8. 


Example 1 


In Unit 23, Linear Algebra II (section 23.1.4), we considered the system of 
equations 


2x + 3y + (—1)z = 1 
Ix + ly +(-1)z =2 


In matrix form it becomes 


Cone 


ar 


The solution set of the system in matrix or column vector form is therefore: 
5 + 2r 
—3-— r]|:reR 
O+ r e 
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Exercise 1 
Find the matrix form of the solution set of the system 
x 7 + 2 =4 
2x +2) —z=35 z 


Existence and Uniqueness Problems 


In section 26.1.1 we noticed that some systems have an empty solution 
set, whereas others have a non-empty solution set. One of the important 
problems in the theory of linear equations is to determine conditions 
under which a system of equations has a non-empty solution set: this 
problem is called the existence problem. 


Once it has been decided whether or not a solution exists, it is useful to 
know the conditions under which the solution set contains just one 
element: this problem is known as the uniqueness problem. 


We have seen that the solution set of the equation 


Ax=b 


iS 


{x:X = xX, + any element of the kernel}. 


Thus, if we can find a particular solution X, and determine the nature of 
the kernel of the mapping, the uniqueness problem is solved. 


If the kernel consists of one element only (which must then be the zero 
element), then the solution set consists of one element only, x,, and so we 
have established uniqueness. If, on the other hand; the kernel consists 
of more than one element, then the system has more than one solution. 


As far as existence is concerned, we are assured of a solution if b is in the 
image set of the mapping defined by A, for in that case there must be 
some vector x which maps to b. 


Thus the existence problem is essentially the problem of finding a test by 
which we can look at A and b and determine whether ) is in the image set. 
If the solution set is non-empty, the uniqueness problem will be solved 
if we can find a way of determining whether the kernel of the mapping 
defined by A contains more than one element. In the following sections 
we shall consider these problems in more detail. 
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Solution 1 


If we try to find a particular solution by putting z = 0, we obtain 
x+y=4 
2k. 4+ 2y = 5. 


We see that there is no particular solution of the original system of the 
form 


OL 
p 
0 


We therefore try putting another variable, y say, equal to zero; we obtain 
the system 


x+z=4 
2 = 2 = 5, 
which has the unique solution x = 3 and z = 1. So 
3 
0 
1 


is a particular solution of the original system. We now wish to find the 
kernel i.e. to solve the system 


x+ y+z=0 
2x + 2y —z=0. 
The solution set of this system is 
r 
—r|:reR 
0 
Hence the required solution set is 
3+PFr 
—r|:reR 


1 = 
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26.2.3 The Existence Problem 


We consider a system of m simultaneous equations in n unknowns, 


X1,X2,...,X,, written in matrix form as 
Ax = b, 
where 
Xj b, 
X2 b, 
= : . b = ’ 
Xn Bin, 


and A is a matrix of order m x n: 


Qi, Ay2°** ay 


n 


Ami m2 a 


mn 


In section 26.2.1 we remarked that we can consider a matrix to be made 
up of vectors. For example, we could write 


Ay, A142 Ain 

Az1 a22 A2n 
a, — 3 a> — y . » Gy, = 

Ant QAn2. Qmn 


If we choose the following basis for R": 


1 0 0 
) 1 0 
€,=|0], e=]| O],...,e,=] 0], 
0 0 ! 
then 
& = Ab, + Az tt + ee" 
and 
Ax = X,Ae, + X,A@, + --- + x,Ae, 
= X10; t+ Xo. + + + X,G,- 
Example 1 
If we write the system of equations 
25S, SS 
34+ i eS 


in matrix form: 


Se) = (} 


then we can write this as 


(J em} (} 


This illustrates the general formula given above. a 
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Now let us return to our problem of the existence of a non-empty solution 
set. Ax is a vector in the image space A(R"). Since AX = X,@, + X2@> 
+--+ + x,q,, this means that any vector in the image space is a linear 


combination of the vectors ad,,d>,...,a,. For a solution to exist, b must 
be in A(R"), and so b must be a linear combination of a;,d),...,d,- 
V U 


Solution if 
be A(V) 


No solution 
if b is 
outside A(V) 


(Here V = R”.) 


So we have what appears to be a simple test which we can apply to find 
whether a system has a solution. Unfortunately the test is not always 
simple to apply in practice. 


The Test 


If b is a linear combination of the vectors d,,a>,...,d,, then the system 
“of linear equations represented | ) Sa ERR Otherwise the 
system has no solution (that is, the solution set is empty). 


Example 2 


Consider the system of equations represented by 


it altel = {6} 


10 7 
We must decide whether the vector b = | = is a linear combination of 


the 2 vectors 
2 
a, 
In fact, we notice that 


el) 2 ( 
a, = 2d;,since|,| = 2x | JJ, 


so that effectively our problem reduces to deciding whether b is a (scalar) 
multiple of a,. In other words, is there a number « such that 


4 
and 4q,= *). 


b = ad,, 
Le. 
fe) = 44 
=f. 37 
6 1 
The equation above holds only if the equations 
10 = Ze 
6= 6 


can be solved simultaneously. Clearly they cannot. It follows that D 
is not a linear combination of a, and a), so that there is no solution to the 
original system of equations. | = 
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(4 minutes) 
Using the theorem given in the text, determine which of the following 


systems of equations have at least one solution. 


X14 + Kq ce 3 3x, + 6x, =9 
(iii) $x, + 4x, =2 (iv) 0.2x, + 0.3x, + 0.1x3 = 1.1 
3x, + x, =8 0.6x, + 0.9x, + 0.3x3 = 2.2. = 
In the examples considered so far, the test to determine whether the Main Text 


system Ax = 6 has a solution was easy to apply. In fact, for a “small” 
system we do not need a test; we can establish whether or not a solution 
exists by trying to solve the equations directly. But for “meatier” systems 

a test is required. However, in such a case, to find whether b is a linear -—— 
combination of the columns of A, we would need to solve a system of 
simultaneous equations, which could be as complicated as the original 
system! Clearly, we must modify the test to make it easier to apply. We 

do this by introducing the concept of the rank of a matrix. 


Given the matrix A = (a, a, ---a,), the rank of A is the maximum number Definition 1 
of linearly independent vectors from the set {21,2,°-+,d,'; it is denoted 

by 7(A). | Notation 1 
Example 3 Example 3 


1 3 
The matrix : i has rank 2, since the vectors | | and | ‘ are linearly 


independent: 


1 3 0 
ra * Meat = 19} eae e 8 


The matrix 


pb 


1 $4 1 
5 j has rank 1, since the vectors | and | | are linearly 


dependent: 


= (continued on page 22) 
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Solution 1 


(i) The system Ax = bis 


(HE) - (3) 


By inspection, 


()-() 4) 


so b is a linear combination of the column vectors of the matrix of 
coefficients A. It follows that the system has at least one solution. 
(ii) The system Ax = Dis 


(JE) - (6) 


In this case, 


= ()-() Ch 


~ It follows that the system has at least one solution. 
(iii) The system Ax = Dis 


Ee) =(e 
ia. s oF 
The two column vectors of A are linearly dependent: 
L 3 + 
a) -2*( 
So the system will a have a solution if the vector b is a multiple 


of (say) the vector (") 46.0 


=U] 
= a} |, where ve€ R. 
8 1 


There is no « such that the above equation holds. The system has 
no solution. 


(iv) The system Ax = bis 
x} 


e7 83 63 SS 1.1 
66.09 63) -*3— 127) 
X3 


The three column vectors of A, d,, a>, a3, are linearly dependent; in 
fact, 


@,=2xa, and @ =3 x qs. 


But the vector b is not a multiple of a. It follows that the system 
has no solution. = 


(continued from page 21) 


We have defined rank in terms of the number of linearly independent 
column vectors, because our discussion has been in these terms. We could 
equally well consider the matrix to be made up of row vectors, and define 
rank in terms of the number of linearly independent row vectors. (In a 
sense, this would be quite natural, since intuitively it connects with the 
number of “independent” equations in the system.) There is a theorem 
(which we shall not prove) which states that these two possible definitions 
of the rank of a matrix are equivalent, i.e. give the same value for the rank. 


Pgs 


FM 26.2.3 


Solution 1 


Discussion 
* 


Exercise 2 


Find the rank of each of the following matrices. 


1 1 0 
ae 6 3 
1 0 1 
F 1 —-1 
a ee 
6 1 3 
= 
Ses eee ee 
= & 


We now reconsider our test for the existence of a non-empty solution set 
in terms of the rank concept. 


We have seen that for the system 
Ax = b, where A = (a, ---q,) 

to have a solution, the vector b must be a linear combination of the vectors 
he eee 


Another way of saying this is that the number of linearly independent 

vectors in the two sets {d@,,@),---,d,,b} and {d1,@,---,d,} must be 

the same. 

In terms of matrices, the last remark means that the rank of the matrix 
Gy Gy =, 


n 


Q21 422°°* Ary 


Ani Gn2°** Inn 


and the rank of the augmented matrix (the matrix A with the extra column 
b): 


G1; @Q@,o°:-@,, 0b, 


Az, 422°*+Q,, db, 


(A b) = 


must be the same. 


We can now phrase the test for the existence of a non-empty solution set 
in the following form: 


The system of linear equations represented by 
Ax =b 


has a non-empty solution set if the matrix A and the augmented matrix 
(A b) have the same rank. 


Unfortunately, with our present techniques, to find whether r(A) is the 
same as r(A b) may still necessitate solving a system of equations which 
is as large as the original system we wish to solve. We shall discuss another 
possible method for determining the rank of a matrix (which is not 
dependent on solving simultaneous equations) in section 26.3.3. 
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Solution 2 
(i 41 1 0 0 
a, }O} +a,;0] +a3, 1] = |0 
1 0 1 0 
=> a, +a, =0 
% = 
a, +a,=0 
=> i; = a, = 2, = ©. 


This shows that the vectors @,, ad) and a; are linearly independent, 
and hence r(A) = 3. 


2 1 —| 
a; =-1414 =1i'tea = 1 |. Youcan verify that 3a, + a; = d,. 
6 1 3 


It follows that the maximum number of linearly independent column 
vectors is less than 3. Looking at the expression 


Aa, + 43a; = Y, 
we see that this is equivalent to 
a, —a,=0 
a, +a, =—0 
a, + 3a, = 0 


The first two equations give «, = 0, and it then follows that «, = 0. 
Thus g, and qa, are linearly independent, so r(A) = 2. 


(iil) ad; = 2d,,43 = 3d). 
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In this case the maximum number of linearly independent column 
vectors is 1, so that r(A) = 1. s 
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26.2.4 The Uniqueness Problem 


Having discussed some theoretical aspects of the existence problem, we 
- how turn our attention to the uniqueness problem. 


In general, corresponding to the equation 
Ax = b, 

where A has order m x n, we have a mapping 
Alz = Ax 


of R® to R™. We know that, for the equation Ax = b to have a solution, 
b must be a linear combination of the vectors a,, a,,°*:,da,. SO we can 
determine the image set A(R”) © R”, as the set spanned Oe ee owe 


—n* 


R"—_______ 4 ——____ 5 R" 


The dimension of this image set is, therefore, the maximum number of 
linearly independent vectors among the q’s. But this is what we have 
defined to be the rank of A, so we have 


r(A) = dimension of A(R"). 


We can get some interesting results by recalling the dimension theorem 


of Unit 23, Linear Algebra II, section 23.1.6. This stated, in terms of 
our context, that 


dimension of A(R") = dimension of R" — dimension of kernel, 
iz. 
r(A) = n — dimension of kernel. 


Now let us suppose that the solution of Ax = b is unique. We know in 
general that the set of all solutions is given by 


{X:X = Xp + Xy, X, € K}, 


where x, is a particular solution and K is the kernel of the mapping A. 
But if, as we suppose, the solution is unique, then there is only one solution, 
so the kernel contains just the one element, the zero vector.* This means 
that the dimension of the kernel is zero, i.e. our result above now becomes 


r(A) = n. 


Thus a necessary condition for the solution of Ax = b to be unique is that 
the rank of A =n, the number of variables in the original equations. 
This condition is obviously also sufficient, i.e. it guarantees uniqueness. 
Because ifr(A) = n, then the dimension theorem tells us that the dimension 
of the kernel is zero, and therefore the kernel is the zero vector space. 
It follows that, if Ax = b has a solution, then it is unique. So we have: 


If a system of m linear equations in n unknowns represented by 


Ax = b 


* Since a = Q, where Q is the zero vector in a vector space, and « # 0, {Q} is linearly depen- 
dent. The dimension of {0} is defined to be zero. It is the only vector space of dimension zero. 
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has a solution, then the solution is unique if and only if 
YA) = 8. 


We can improve on this result if we simplify our case. For, if we assume 
that n = m,i.e. the number of equations is equal to the number of variables, 
then we can include existence with uniqueness. That is, 


The system of n equations in n unknowns represented by 
Ax =b 

has a unique solution if and only if 
r(A) = n. 


We have already shown that, if a solution exists, it is unique, and to prove 
existence is not difficult. Since n = m, the image set A(R") is now a subset 
of R". Since the column vectors a@,,d>,°:-,d, are linearly independent, it 
can be shown that they form a basis for R”. (We stated this result in section 
22.2.3 of Unit 22, but we shall not prove it in this course.) This means 
that any be R" can be expressed as a linear combination of a;,42,°--.@n- 
It follows that Ax = b has a solution. 


In section 26.2.3 we showed, in general and not only when n = m, that a 
sufficient condition for the existence of a solution of 


Ax =)b 
is that 
r(A) = 7r(A b). 


We have now shown that when n = m, a necessary and sufficient condition 
for the existence of a unique solution is that 


r(A) = n. 


Let us consider the case where m = n, so that we can compare the above 
two results. 


Suppose 
r(A) = n. 
Then 
r(A b) > r(A) = 7. 


Since the columns of (A b) are elements of a vector space of dimension n, 
it follows that at most n of them are linearly independent, i.e. 


r(A b) < n. 
Hence 

r(A b) = n. 
That is, 

r(A) = n= 17(A) = 7A 9). 
On the other hand, 

r(A) = r(A b) # r(A) = 7. 


Example 1 

The system 
x—-y=2 
x+y=2 


has the unique solution x = 2, y = 0. 
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Here 
4=[' }ae=(' —1 = 
1 1 1 1 Fs 
and 
1A} = 7A Db) = 2 
The system 
at Zy = 2 
ey = 1 


has many solutions of the form x = a, y = 1 — a. 
In this case, 


sf 4. ae-(2 3 


1 ee ee 
and 
r(A) = r(A b) = 1 < 2. 
z 
We have now completed, as far as we intend to go, our theoretical studies Main Text 


Rk 


of existence and uniqueness. But before we go on to other things, we 
introduce a few terms and notation which are standard in the literature 
on linear algebra. 


When the number of equations is equal to the number of variables, the 


matrix of coefficients is said to be square. A matrix with m rows and n Definition 1 

columns is often said to be of order m x n. The square matrix A of order Definition 2 

n X n (or sometimes “‘of order n’’) is said to be non-singular if r(A) = n. Definition 3 
ee 


Otherwise A is called singular. 
In general, the mapping 
Ay AZ 


is a homomorphism, but if the matrix is non-singular, the mapping is an 
isomorphism of R” to R". In this case, the mapping has an inverse which 
is also an isomorphism. We denote the matrix of the inverse mapping, 
and also the inverse mapping itself, by A~'. In terms of mappings, we 
have 


and 
As A * yey 


If I,,, denotes the identity matrix of order n (see Unit 23, section 23.2.4), 
then in terms of matrices we have 


A tA=AA'= Se 
A~* is called the inverse matrix of A. Definition 4 
If 

Ax = b 
has a unique solution, X,, then we can write 


x,=A 'b. 


In section 26.3.2 and in Unit 28, Linear Algebra IV, we shall see how to 
calculate A~', and then this formula can prove useful; for instance, we 
may want the solutions of several sets of equations with the same A, but 
various b. 


oe 


26.2.5 Summary 


In section 26.2.1 we introduced the matrix form ofa system of simultaneous 
linear equations: 


Ax = hb. 


In section 26.2.2 we gave a general discussion of the nature of the solution. 
In particular, we mentioned the existence problem: 


Does a solution exist? 
and the uniqueness problem: 
Is there a unique solution? 


In section 26.2.3 we discussed the existence problem in detail. We defined 
the rank of a matrix: 


rank of A, r(A) = (maximum number of linearly independent 
columns of A) 


and the augmented matrix: 
(Ab) = [4 : | 3 


We gave the following theorem: 


r(A) = r(A b) 


= Ax = bhasa non-empty solution set. 


In section 26.2.4 we discussed the connection between the uniqueness 
problem and the rank of a matrix; we produced the following theorem: 


If Ax = b is a system of linear equations in n unknowns, for which a 
solution exists, then 


the solution is unique < r(A) = n. 


A summary of the discussion on the existence and uniqueness problems 
is given below in diagrammatic form. 


Matrix Equation 
Ax =) 
Does a solution exist? |NO 
(existence problem) 
Yes 
Js the solution unique? |YES 
(uniqueness problem) 


No further 


investigations 


NO Find the unique 


solution 


Find the 
solutions 
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Summary 
x*wr 


Ax =b 
A is of orderm xn 


More than 
one solution 


Gra O 
-? 


YES 


The solution 
is unique 


x= AES"*h 


26.3 ELEMENTARY ROW OPERATIONS AND 
THEIR USE 


26.3.1 Elementary Matrices 


In section 26.1.2 we discussed one practical method for solving a system 
of equations, the Gauss elimination method. We then used the matrix 
notation, which is convenient for investigating the problems of the 
existence and uniqueness of solutions. We shall now look at the solution 
of a system of equations using the Gauss elimination method, but in 
terms of matrices. This has no practical advantage; in fact, it is a dis- 
advantage. But it does allow us to discuss certain theoretica] aspects of 
the method which have definite practical repercussions. 


In section 26.1.2 we defined three elementary operations used in the Gauss 
elimination method. We shall show that the equivalent operations, when 
the equations are written in matrix form, are multiplications of the co- 
efficient matrix A by appropriate matrices. For simplicity we shall confine 
our attention to matrices of order 3 x 3, but the method we discuss is 
very general and can be applied to matrices of any order. 


We define three elementary row operations on a matrix A: 


(i) interchange any two rows of the matrix: 
(ii) multiply any row of the matrix by a non-zero number; 
(iii) add a multiple of one row to another row. 


We shall denote the first, second and third rows of the matrix A by R,, R, 
and R3 respectively. 


We denote an elementary row operation by E; and abbreviate the descrip- 


tions as follows. 
Interchange of R, and R; is written 


E, -R, => K.. 
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26.3.1 


Introduction 
*x * 


Main Text 
kk * 


Definition 1 
kkk 


Notation 1 
ba ae 


Multiplication of R, by the number k is written 
EK ky 

Addition of a multiple, k, of R3, to R, is written 
E,:R,*—— R, + KR;3. 


Example I 


Consider 

/! 7 

— 4 

‘: 2 —2 

E,:R, + R,, changes A to 
& 4 
Eisai i -0— “33. 
\ G3 


E,:R,'—— 3R, changes A to 


iS 3 
Bidets - 3-3, 
eo 
and changes E,(A) to 
SS See 
EEA) = |3 ——— s 
\1 0 -—2 


\ 


E,:R,+—— R, — 5R; changes A to 


i Q 3 
—4 1 iy, 
eS 0 —2 


and changes £,(A) to 


j i —— 
1 0 -—2 


It is a remarkable fact that these operations can be performed on a matrix 
A by premultiplying A by particular matrices. The most direct method of 
demonstrating this is to find the matrices which perform the required 
operations. How do we find these matrices? There is a particularly simple 
way to do this. If we assume that such matrices exist, then they must 
perform the same operations on the identity matrix, in particular. For 
example, if E is assumed to be a matrix which interchanges the first and 


third rows of a3 x 3 matrix, then 


/ 


E=EI=E\0 1 
e J 
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since we know that E interchanges the first and third rows. Now let us 
premultiply a general matrix by E: 


0 0 I\ [ay; 4,2 443 431 432 433 
0 | O}| G21 G22 G23] =] 421 G2 43]. 
1 0 0} \a3, 432 433 Gi; 412 443 


We see that E has the required effect on any 3 x 3 matrix. This leads us 
to the following definition. 


A matrix obtained from the unit matrix by an elementary row operation Definition 2 
is called an elementary matrix. 3 


Example 2 Example 2 
We shall find the elementary matrices corresponding to the row operations 
Ek, he, 2 Re and B7ho 7, — 5R, 


which we used in Example 1. We shall then premultiply the matrix A of 
Example | by the elementary matrices found, and note the results obtained. 


We begin with the identity matrix: 


1 0 0 
P= 10 1 0 |. 
0 0 1 
Lo 
Writing E, to stand for the aie as well as the operation, we get 
0 1 0 
£, = {1 0 0]; 
0 0 1 
0 1 0\ /1 0 3 1 1 1 
na-| 0 O}1 1 1 Fi=t4 0 34. 
Se ee 
E,: R21 3K, 
1 0 0 
Eo =19 3 | 
0 0 1 
1 0 O\ /1 0 3 1 0 3 
E,A =| 0 e) 0}; 1 1 f=75 3 3 


Fe = SR; 


1 0 0 
£,=1490 1 —S5]; 
0 0 1 
1 0 0\ /1 S32 | 0 3 
E,A = | 1 —S]}1 1 1}= |; —-—4 See 
0 0 Hi i 0 -2 1 0 -2 
You should compare these results with those of Example 1. = 


31 


FM 26.3.1 


Exercise | Exercise 1 
; (2 minutes) 
Find the elementary matrices of order 3 x 3 corresponding to each of the 


following: 


(i) KR, +> KR; 
(11) a Fs = 2R, 
(iv) + 5. ee R, + 2R,; 


Verify that the elementary matrices have the desired effect by applying 
them to the matrix 


1 Z 3 
Z 4 6 
= SS ee = 
We have seen that, to each elementary row operation used in the Gauss Discussion 


elimination method, there corresponds an elementary matrix. 
It appears that we have an isomorphism between 


(1) the set of elementary operations carried out on the system of simul- 
taneous equations, combined by successive performance, 
and 

(2) the set of elementary matrices, combined by matrix multiplication. 


The object of the Gauss elimination method is to use a finite sequence of 
elementary operations to reduce a system of equations into any equivalent 
system which can be solved simply by back-substitution. We shall now 
reinterpret this in terms of matrices. 


Suppose we start with the system of equations written in matrix form as 


Ax = b, 
that is, 
Oy; 853-3 Xj by 
42; 422 433 X2}| = | db, 
43; 432 433 X3 b; 


The object is to reduce this system to the equivalent system 
Cx = g, 


that is, 
Gy G;, M3 xX} LA 
0 g2  ¥35 X2 


0 0 C33 x3 d, 


| 
a 
to 


If E, represents the first elementary operation which we carry out on the 
Original system, we now premultiply both sides of the matrix equation 
by E,, to obtain 


E,Ax aed Eo. 


This new equation represents a system of equations equivalent to the 
first. Notice that by premultiplying A and b by E, we are effectively doing 
the elementary operation. So there is no point, in any practical calculation, 
in finding the matrix E and actually doing the matrix multiplication: 
it is much easier to carry out the appropriate row operation on the 
augmented matrix (A b). The only value in knowing of the existence of 
the matrix E.is in theoretical considerations which may have practical 
consequences, but the matrix E itself is not used in practice. 


a4 


We have seen that each elementary operation corresponds to an elemen- 
tary matrix. It follows that a sequence of elementary operations corres- 
ponds to a product of elementary matrices. Suppose the sequence of 
matrices, in order of usage, is E,,E,,E3,...,E,. Then, what we are 
doing can be written in the form 


(z.. Sie E,E,E,A)x = z. ee E,E,E,b. 


Notice that, because we are always premultiplying by the E’s, the column 
vector x is never involved. When setting out numerical calculations we 
drop the x and just keep the augmented matrix (A b) and manipulate 
that. We have 


(Cd) = (E,... E3E,E,)(A b) 
= P(A 5), 


where P is the matrix obtained by multiplying all the E’s together. In- 
cidentally, we know that if we can get from (A b) to (C d), we can reverse 
each step (each elementary operation can be reversed by another elemen- 
tary operation of the same kind) and get from (C d) back to (A b). This 
means that the matrix P is non-singular, 1.e. it has an inverse matrix 
P~'. Notice that we said “if we can get from (A b) to (C d)’”’: we have no 
guarantee that we can. In fact, it is always possible, although some of the 
c’s may be zero. If the solution of the system of equations is unique, i.e. 
if r(A) = 3 (or, in general, if r(A) = n for a square n x n matrix), then 
none of the c’s on the leading diagonal is zero. 


We have now achieved the object of this section, which was to interpret 
the Gauss elimination method in terms of matrices. There are a number 
of interesting consequences and refinements which we shall consider 
in the remainder of this text. 


Exercise 2 


Find elementary matrices which reduce the system 


2 1 -1 x; 3 
6 -1 -9 Xx, } = 47 
4 3 1 X 5 
to the system 
2 1 -1l xX; 3 
0 —4 —-6 Si = 7 —2 
=! 3/ \x, —3 
Hence find the matrix P and verify that 
a a ee | oe ee 
0 —-4 —-6 1 —2}/=P!6 -1 -9 ! 7 
a bocce $2 38 s 
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Exercise 2 
(2 minutes) 


Solution 1 
(i) | 1 0 0 (ii) 1 0 0 
0 0 it —2 1 0 
0 1 0 0 0 1 
(iii) / 1 0 0 (iv) 1 0 0 
0 1 0 —1 1 2 
2 3 1 0 0 1 ze 
Solution 2 


The E’s are not unique: they will depend on which elementary operations 
are chosen. But P is unique: : 


1 0 0 
«3 I 0 
ee 


A possible choice of elementary matrices is 


1 0 0 a = ea 1 0 0 

2S G1 06-32) 04 3 £9 

ae ee ee o-34 —i 1 4 
E; KE; E, P % 


26.3.2 The Inverse of a Matrix 


There are a number of ways of finding the inverse of a non-singular 
matrix A. In this section we shall exploit the elementary matrix technique 
discussed in the last section. This is a good example of the way in which 
elementary matrices, although not themselves practical, lead to practical 
methods. 


Suppose that A is a non-singular matrix and that X is its inverse. Then 
XA = AX = I, 


where A, X and / are square matrices of the same order. We can consider 
the equation AX = / as an equation from which we wish to determine 
the unknown matrix X. It is, in fact, not very different from our previous 
equation. For instance, if we suppose that A, X and J are all 3 x 3, then 
we can write 


AX, xX. RH b 13), 


where we have expressed the matrices X and I in terms of their column 
vectors in the usual way. This one matrix —— is then equivalent to 
the three matrix equations 


Ax, = ii. Ax) = 1), Ax; = 13, 


and we are back to the problem of solving the equation Ax = b, except 
that we now have to solve three matrix equations instead of one. 


This suggests that the same approach might help here. We can perhaps 
find a sequence of elementary operations (with corresponding elementary 
matrices) which together form the Gauss elimination method. The 
same sequence of operations would, of course, do for all the three equa- 
tions. This approach would certainly work, but a little more effort will 
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Solution 2 


26.3.2 


Main Text 
x * 


give a much bigger return. The Gauss elimination method requires 
back-substitution; we can avoid back-substitution if we carry out some 
more elementary operations. Instead of reducing A (in the 3 x 3 case) to 


the form = — = ‘et C = Ciz 

0 : eS Oo Ges Ses 

0 C33 ae) oO = 33 
we could carry on, and try to reduce it all the way down to 

1 0 0 

0 1 Ot; 

0 0 1 


still using elementary operations. Then we could read off the solution 
without back-substitution. 


Let us suppose that we can find a sequence of elementary operations 
which transform A into IJ. We shall denote the corresponding elementary 
matrices by E,, E,,...,E,. Then starting from our original equation 


AX = IT, 


we have 
ssh ADA = B.Ed, 


that is, 
ef ae eee 


or 
X= £...E¢4 


This is a remarkable result which has practical consequences. It tells us 
that if we can find a sequence of elementary operations which transforms 
A into I, that same sequence of operations will transform / into the inverse 
of A. The elementary matrices give us the justification, but in practice we 
do not use these — we use their effects — the elementary operations. 


Example 1 
Find the inverse of the matrix 
2 1 -1 
A=|6 -1 -9 
~ 3 1 


There is no harm in assuming that the inverse exists: we have no reason 
to suppose either that it does or that it does not, but the proof of the 
pudding will be in the eating. If we can find a sequence of elementary 
operations which transforms A into I, then the inverse of A exists. Since 
we are going to perform the same elementary operations on the rows of 
A and I, we get ourselves into battle array, dropping matrix brackets. 


SS Se ae Se 

| | 
SF a a 
a Se ee ee 


You may be wondering where the last column came from. As we mentioned 
in our notes on the Gauss elimination method, any good numerical 
method should incorporate a check of some sort. So we have introduced 
an extra figure at the end of each row, which is the sum of the numbers 
in that row. In the calculation we treat it as part of that row, so that what- 
ever we do to the row (by an elementary operation), the last number 
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Example I 


should still be the sum of the numbers in that row. If, after a certain step, 
we find that the sum-check fails, then there is an error somewhere in that 
step. As long as we remember to check the row sum after each step, we 
should be reasonably sure of getting the whole calculation right. (Only 
reasonably sure, because we may have made compensating errors.) 
We now proceed systematically to produce the matrix J in the first three 
columns, indicating each step by our usual notation. 


ft 

| | 
es ee 
es eee eS eee SSS 


(When you get adept at the game, then you don’t need to copy down all 
the rows at each step, but only the ones that change; for example, the 
first row above. We shall not do this because it can be a bit confusing for 
the beginner, but we shall occasionally do more than one step at one go.) 


2 SS ee 
| | 
be Si ee 
ee ee ee ee eee Se 


f= 4 a ee 
Se 
es Se Ee ee ee Se 
Ke KR — Sh, RR, Se 
ee ee ee ee 
0 1 $1 % -£ 0 =. 
. 2 f= 2 
We now have two columns correct. 
R,'—>3R; 
i § =, + 4-4 
ee 3 
o G0 1,-¥ ¢ 4, 0 
R,— R, + 3R3; RR, R;, — 3R; 
i- 8 6-9 £ + 6 
4 0 ot | 3 
6. @ 1'-} 2 27,3 


‘We now have all three columns correct. 


If our theory is correct, then the inverse of A is 
5 


Ee NIN 
| 

Ale NI Whe. 
| 
pared, 


To check that this matrix is indeed the inverse of the matrix A, do Exercise 
1. 
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Exercise | 
Given that 
2 iol -B 4 4 
A=|6 -1 —9|]|andX = 3 —4 -1}, 
2s Hf 3 
show that 
AA =I = AX, 
where 
1 0 0 
i 1 0 
0 0 | a 
Exercise 2 


Find the inverse matrices of 
(i) / 1 —-1 0 (ii) 0 1 -1 
3 7 1 3 6 2 
2 -14 2 —1 0 5 


Set out the calculations by hand, or, if you have the time and inclination, 
use the computer program (given in the Appendix) to perform the elemen- 
tary operations for you. B 


We now have a technique for finding the inverse of any non-singular 
matrix. The question may naturally arise in your mind: What is the use 
of it? We have briefly answered this question earlier, but we shall now 
discuss it more fully. 


If we have a system of equations 


Ax =, 


where A is a non-singular square matrix, then, since the inverse matrix, 
A~', represents the inverse isomorphism, there is a unique solution to 
the system; it is 


= 


The important thing about it is that, once we know A~!, we can find a 
unique solution for any column vector b. This is a distinct advantage 
over the Gauss elimination method, where, for a different choice of b, 
we would have to do the Gauss elimination again. (Although, of course, 
only the b column would be different and so, provided we had kept a 
record of our previous calculations, the work involved would not be as 
hard as it may seem at first sight.) 


We shall see in Unit 28, Linear Algebra IV that if we have a set of systems 
of equations 


a5 =), i= 2... 


with the same coefficient matrix but a number of different right-hand 
sides, then, provided n > 3, it is well worth while finding A~‘, and for 
each i, calculating the solution 


A-'b.. 


Although we have restricted our considerations here to non-singular 
matrices, and we have no effective method of looking at a square matrix 
and telling whether it is non-singular, the method described in this section 
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Exercise 1 
(3 minutes) 


Exercise 2 
(3 minutes) 


Discussion 


x * 


(continued on page 38) 


Solution 1 
Just multiply out. & 
Solution 2 
(i) 1 -1l 0 
The inverse matrix of | 3 7 1 
2 =14- 2 
2 = = —— = 
8 16 32 
a Se ee 
a: 3 : = 
4 8 16 


If you did it by using the computer program, you should finish up with 


875 .0625 — 03125 
— 125 .0625 — 03125 
— 1.75 aio mAs, 
(ii) 0 1 -1l 
The inverse matrix of 3 6 2 
—| 0 5 
a8 a 
ae 23 zs 
2 = 
a = = = 2 
aa 23 ZS 


If you did this one by using the computer prograrn, you should get some- 
thing like 


— 1.30435 217391 — 347826 
73913 4.34783E-02 130435 
— 26087 4.34783E-02 130435 a 
(continued from page 37) 


is still useful. Even if it does not lead to the inverse matrix, some of the 
same steps will lead to a solution (or solutions) if one exists: if no solution 
exists, it will tell us this as well. We shall not go into these points here. 
They are not difficult, but we have gone far enough into the theory of 
linear equations for the time being. 


We shall turn briefly, in the next section, to the calculation of rank. 
This involves a similar discussion to the one above. 
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26.3.3 Calculation of the Rank of a Matrix 26.3.3 


Although we have stated some of the results in this text in terms of the Main Text 
rank of a matrix, we have not discussed an effective way of calculating 2 

it (our examples were artificially easy). In this section we shall make good 

this deficiency. We shall restrict our discussion to square matrices for 

simplicity. 


Given a square matrix A, we have defined the rank of A as the maximum 
number of linearly independent column vectors in A. 


If A is ann x n matrix, then we can associate with A the mapping 
Aix Ax (x € R”), 

and we have shown in section 26.2.4 that 
r(A) = dimension of A(R”). 


We shall consider the effect of one of the elementary row operations on 
the rank of A. Although we cannot necessarily readily tell the rank of A, 
we can tell the rank of a much simplified associated matrix (for instance, 
of the form obtained in the Gauss elimination process). 


Let E be the matrix corresponding to one of the elementary row operations. 
The corresponding mapping 


£5 Ex (x € R") 


is one-one, because, as we have already noted, every elementary row 
operation has an inverse operation of the same type. 


Consider the composite mapping 
Eo A:x+——> EAx (x € R") 
with matrix EA. We have 
r(EA) = dimension of E ° A(R") 
= dimension of E(A(R")) 


But, as we saw in section 26.2.4, since E is one-one, the kernel of the E 
mapping contains just the zero element, and so is of dimension zero: 
that is, | 

dimension of E(A(R")) = dimension of A(R") = r(A). 
So 

r(A) = r(EA). 
This means that the rank of A is unaffected by an elementary row operation. 
This leads to a practical method of calculating rank. 


Example 1 Example 1 
We calculate the rank of the matrix 


1 0 -1l 
A= | -—2 1 3 
4 2 —2 


by systematically reducing the elements below the leading diagonal 
(from top left to bottom right) to zero, using elementary row operations. 
We use a row sum, as described in the previous section, to act as a check 
for the arithmetic. 


2 Se Se 

| 
ee Pa 
a a ee 
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RK. kz = i 2R,;R3-— kK; = 4R, 


= 

= Ea 2 

ae ee 
R3'— R, — 2R, 

;- s =t7s 

a re. 

eS ee ee 


It is now easy to see that the first two columns are linearly independent, 
but 


—1 1 0 
fy = —F U3 4+ 72 4. 
0 0 0 


so r(A) = 2. 


In fact, if we use the result, mentioned in section 26.2.3, that the row rank 
(the maximum number of linearly independent row vectors) is equal to 
the column rank, we can see the rank of A even more easily, since the last 
row consists entirely of zeros. In general, if we carry out this reduction, 
the rank of A is equal to the number of “‘non-zero” rows in the reduced 
matrix. 2 


Exercise 1 


Calculate the rank of the following matrix: 


1 S. 1 

0 1 1 

2 -1 -l = 
Exercise 2 


Use methods similar to those in the text to prove that, if Bis ann x n 
non-singular matrix and A is any n x n matrix, then 


r(BA) = r(A). | = 


Exercise 3 


If A and B are any n x n matrices, prove that 


r(BA) < r(A). | |e 
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Exercise 1 
(2 minutes) 


Exercise 2 
(4 minutes) 


Exercise 3 
(5 minutes) 


26.4 SUMMARY 


We have come full circle. Towards the beginning of the text we described 
the Gauss elimination method for solving a set of simultaneous equations 
in terms of elementary operations on the equationsin the system. 


Then we discussed the problem of the existence and uniqueness of the 
solution of such a system and obtained two theoretical results in terms 
of the ranks of the matrices describing the system. These results were: 


The system of linear equations represented by 


Ax =? 


has a non-empty solution set if r(A) = r(A b). 
The system of n equations in n unknowns represented by 


Ax =D 


has a unique solution if and only if 


r(A) = n. 


We then “‘changed direction” and defined elementary matrices. These 
correspond to the elementary operations in the Gauss elimination method. 
We thus obtained a matrix representation of this method. Although 
this had no direct practical interest, it had practical consequences. It 
allowed us to develop: 

(i) a method for finding the inverse of a non-singular matrix, 


and 
(ii) a method for calculating the rank. 


Since both these methods use essentially the same systematic procedure 
as the Gauss elimination method, we can use the same calculations to 
determine: 

(i) the solution to a system of equations, 

(ii) the inverse of the matrix of coefficients, if it exists, 
(iii) the rank of the matrix of coefficients or the augmented matrix, 


whichever is of interest. 
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Solution 1 Solution 1 
The rank of the matrix is 3. 
Solution 2 Solution 2 


Since B is non-singular, we can apply the same argument to B as to E 
in the text preceding Example 1. That is, 


r(BA) = dimension of B(A(R")) = dimension of A(R") = r(A). 


Solution 3 | Solution 3 
r(BA) = dimension of B(A(R")), 
and from the dimension theorem, 
dimension of B(A(R")) = dimension of A(R”) — dimension of 
kernel of B with domain A(R”). 
Since the dimension of any vector space is greater than or equal to zero, 
r(BA) = dimension of B(A(R")) < dimension of A(R") = r(A). 


Similarly, r(BA) < r(B) as well; so the rank of the product of two matrices 


is less than or equal to the rank of either matrix. eS 
26.5 APPENDIX 26.5 
Computer Program SROWOP Appendix 


This program will perform the row operations which you need in order 
to simplify or invert a matrix. In particular it will: 


(a) Interchange two rows, upon the instruction INT, followed by the 
numbers of the two rows you wish to interchange. 

(b) Multiply a row by any non-zero number, upon the instruction MULT, 
followed by the number of the row, then the number you wish to 
multiply it by. 

(c) Multiply one row by any number, and add the result to another row. 
It does this on the instruction MARS (short for ““Multiply and Add 
RowS’’), followed by 


(1) the number of the row to be multiplied ; 
(ii) the number by which it is to be multiplied ; 
(111) the row to which the result is to be added. 


Sometimes the number you want to multiply by is the reciprocal of one 
of the entries of the matrix. To cope with this eventuality, we have also 
prepared the program so that the computer will accept the following 
instructions (logically redundant, but practically useful): 


(d) Divide a row by any non-zero number, upon the instruction DIV, 
followed by the number of the row, then the number you wish to 
divide it by. 

(ec) Divide one row by any non-zero number, and add the result to another 
row. It does this on the instruction DARS (short for ““Divide and Add 
RowS’’) followed by 


(i) the number of the row to be divided ; 
(ii) the number by which it is to be divided ; 
(111) the row to which the result is to be added. 
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Running Instructions 


Log in at the computer terminal in the normal way. When you have logged 
in, type 


GET-SROWOP 
followed by the carriage-return, then type 
RUN 
followed by the carriage-return again. The computer will print 
? 
and you must input two numbers (which must not be greater than 10); 


these are the number of rows, and the number of columns, of the matrix 
you are going to work with. For instance, if you type 


43 
followed by the carriage-return, then you have told the computer to 
expect a 4 x 3 matrix, i.e. a matrix with 4 rows and 3 columns. 
The computer will again print 
: 
and now you must input the entries of the matrix, in lexicographic order, 


i.e. the entries of the first row, in order, then those of the second row, in 
order, etc. For instance, if you want to input the matrix 


Se 
3-34 
os oe 
ee ee 


(which is a 4 x 3 matrix), your input at this juncture would be 

F121 2.3,2, 13044 
followed by the carriage-return. 
The computer will again print 

? 
and this time you can give one of the instructions INT, MULT, MARS, 
DIV or DARS, followed by the carriage-return. You will again get 

? 
and you must put in either two or three numbers, as already indicated, 
to complete the specification of the row operation. For instance, suppose 
you had typed DARS and wished to divide row 3 by 2 and then subtract 


it from row 1. This is equivalent to dividing row 3 by —2 and adding it to 
row lI, so you type 


3, —2,1 


followed by the carriage-return, and the computer will perform the 
operation and type 


? 
awaiting further instructions. 


At this or any other stage (even immediately after inputting the matrix, 
if you wish), you can, instead of giving an INT, MULT, MARS, DIV or 
DARS instruction, give the instructions PRINT, RET, NEXT MATRIX 
or FIN. The PRINT instruction will cause the computer to print out the 
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matrix as it has evolved so far. If you wish to undo the effect of the oper- 
ation you have just performed, the instruction RET will regain the matrix 
as it was prior to the last row operation you performed. 


When you have finished working on a matrix and wish to go on to the 
next one, give the instruction NEXT MATRIX, and the computer will go 
back to the beginning of the program, ready for you to input the details 
of another matrix. 


When you have finished with all the matrices, give the instruction FIN. 
The computer will terminate the program, and print 


DONE 
You sign off at this point with 
BYE 


and record the time taken. 


Error Diagnosis 


If at any stage in the program, you type in something which does not 
make sense at that particular point, the computer will print out some 
statement which will tell you what was wrong. Here is a (hopefully) 
complete list of what to expect. 


If you get 
EXTRA INPUT — WARNING ONLY 


this means that you tried to put in too many numbers. For instance, 
after a DIV instruction you may have typed 1, 2, 3 by mistake. The com- 
puter will take the 1 and 2 and act on them, and the program will proceed. 


If you get 
?? 
then you did not put in enough numbers. For instance, after a MULT 


instruction you may have typed 1, 2. In this case, you must type in the 
missing number(s), and the program will proceed. 


If you get 
22? 
this means that you tried to put in something other than numbers (e.g. 


MULT, or something), where you were supposed to give numbers. In 
this case you must give the correct response, and the program will proceed. 


The above messages are part of the computer’s automatic repertoire. 
The messages which follow are part of the ROWOP program, and subject 
to our control. We have arranged it so that, if you make three of the follow- 
ing types of error in succession, the program will terminate. You will have 
to type 


BYE 


and record the time taken, then go away and re-think what you are doing. 


If when specifying the number of rows and columns of the matrix, you 
fail to give positive integers less than or equal to 10, you will get the 
message 


INADMISSIBLE VALUES 


and you will have to specify the values again. 
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If when giving numbers to specify row operations, you give numbers 
which are not positive integers less than or equal to the number of rows 
in the matrix, you will again get 


INADMISSIBLE VALUES 


and this time you must go right back and re-specify an operation, with a 
command such as INT, MULT, etc. 


If when you are supposed to give a command such as INT, MULT, etc., 
you fail to do so, you will get the message 


INADMISSIBLE OPERATIONAL COMMAND 
and you must specify such a command properly. 


If you specify a row operation whose effect would be to reduce a row to 
zero or try to divide by zero you will get 


LETHAL ROW OPERATION 


The computer will not carry out this operation, and will take you back 
to the point in the program where you have to specify INT, MULT, etc., 
again. 

Summary 


Having logged in, recorded the time, typed GET-S$ROWOP and RUN, 
you must input the number of rows and columns of the matrix. Then 
you must input the entries of the matrix. Then you have, at each step, 
the following choice of instructions: 


INT 

MULT 

MARS 

DIV 

DARS 

RET 

PRINT 

NEXT MATRIX 

FIN 
After INT, input ij, and the computer interchanges rows i and j. 
After MULT, input i,x, and the computer multiplies row i by x. 


After MARS, input i,x,j, and the computer multiplies row i by x and adds 
the result to row j. 


After DIV, input i,x, and the computer divides row i by x. 


After DARS, input i,x,j, and the computer divides row i by x and adds 
the result to row j. 


The instruction RET undoes the last row operation that was performed. 
The instruction PRINT prints out the matrix so far. 


The instruction NEXT MATRIX prepares the computer to receive the 
next matrix. 


The instruction FIN causes the program to terminate. The computer 
types DONE, you type BYE and record the time. 
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Unit No. Title of Text 


Functions 
2 Errors and Accuracy. 
3 Operations and Morphisms 
4 Finite Differences 
5 NO TEXT 
6 Inequalities 
2 Sequences and Limits I 
8 Computing I 
9 Integration I 
10 NO TEXT 
11 Logic I — Boolean Algebra 
12 Differentiation I 
13 Integration II 
14 Sequences and Limits II 
15 Differentiation II 
16 Probability and Statistics I 
17 Logic II — Proof 
18 Probability and Statistics Il 
19 Relations 
20 Computing II 
21 Probability and Statistics ITI 
aa Linear Algebra I 
. Linear Algebra II 
24 Differential Equations I 
25 NO TEXT 
26 Linear Algebra III 
Zi Complex Numbers | 
28 Linear Algebra IV 
29 Complex Numbers II 
30 Groups I 
31 Differential Equations II 
32 NO TEXT 
LS Groups II 
34 Number Systems 
35 Topology 
36 Mathematical Structures 
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